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1.  Introduction 

Complementarity  plays  an  important  role  in  both  general  equilibrium 
theory  [1]  and  mathematical  programming.  We  will  be  concerned  with  the 
linear  complementarity  problem  (LCP)  of  finding  an  x in  R^  such  that 

Mx  + V > 0,  X > 0.  <x,(Mx  + v)>  * 0 (LCP) 

where  M is  a given  n x n matrix  and  v is  a given  vector  in  R 
Applications  of  this  problem  can  be  found  in  such  areas  as  economics, 
engineering,  and  game  theory  (see,  for  example,  [2],  [7]  ).  A number 
of  algorithms  [4],  [7],  [9]  have  been  specifically  designed  to  take 
advantage  of  the  special  structure  it  offers.  In  each  case,  however, 
their  applicability  is  limited  by  the  requirement  that  M satisfy 
certain  conditions.  In  this  paper,  we  offer  a solution  to  LCP  that  is 
independent  of  the  structure  of  M . Our  approach  is  based  on  Mangasarian's 
[8]  observation  that  the  linear  complementarity  problem  is  equivalent  to 
minimizing  a piecewise  linear  concave  function  of  a polyhedral  set 
contained  in  the  nonnegative  orthant;  i.e.. 
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n 

min  Z { mln(0,  M x-  x + v ) + x.  } (1) 

xcs  1=1  1 1 1 i 

where  S = {x:Mx  + v>0,  x>0}  and  is  the  1th  row  of  M . 

In  the  manner  described  by  Bard  and  Falk  [3],  a general  branch 
and  bound  algorithm  Is  used  to  solve  a separable  representation  of  (1). 

In  fact,  if  Mx  + V in  LCP  is  replaced  by  g(x)  , where  g is  an 
implicitly  separable  function  which  maps  r”  into  itself,  the  same 
methodology  can  be  used  to  solve  the  more  general  problem  that  results. 

In  the  next  section,  a brief  discussion  of  the  branch  and  bound 
algorithm  is  given.  Following  this,  the  characteristics  of  a linear 
program  (LP)  equivalent  to  LCP  are  presented  and  a comparison  is  made 
between  this  problem  and  the  series  of  subproblems  set  up  by  the  algorithm 
under  the  branch  and  bound  philosophy.  Special  attention  is  paid  to 
the  case  where  the  algorithm  can  be  expected  to  produce  a solution  to 
the  linear  complementarity  problem  on  its  first  iteration.  Finally, 
two  examples  are  presented  and  the  results  contrasted  with  alternative 
solution  techniques. 

2.  The  Branch  and  Bound  Algorithm 

The  algorithm  that  we  will  use  for  the  computations  was  proposed 
by  Falk  [5]  and  coded  by  Grotte  [6].  As  applied  to  nonconvex  problems 
with  linear  constraints,  it  provides  approximate  solutions  by  replacing 
each  of  the  original  functions  with  their  piecewise  linear  convex  envelopes. 
The  branch  and  bound  procedure  solves  this  lower  bounding  problem  first 
to  get  estimates  on  the  optimal  value  of  the  approximating  problem,  and 
to  set  up  new  problems,  if  the  estimates  do  not  yield  a global  solution. 
When  all  the  original  functions  are  piecewise  linear,  as  they  are  in  (1), 
the  solution  will  be  exact,  rather  than  approximate. 

Branch  and  bound  algorithms  designed  to  solve  mathematical  programs 
generally  produce  sequences  of  upper  and  lower  bounds  that  converge  at  the 
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optimal  value.  This  is,  indeed,  the  case  with  MOGG  (the  computer  code); 
however,  if  a solution  to  LCP  exists,  the  value  of  the  objective  function 
in  (1)  at  the  solution  will  be  zero.  Knowing  this  fact  greatly  improves 
the  efficiency  of  the  algorithm  by  permitting  an  independent  check  for 
convergence  to  be  made  at  each  iteration. 

3.  An  Equivalent  Linear  Program 

Hangasarlan  [8]  has  shown  that  for  any  real  n x n matrix  M , 
if  the  solution  to  LCP  exists,  it  can  be  obtained  by  solving  the  linear 
program. 


min  { cx:  x e S } (LP) 

where  c is  some  suitable  vector  in  R^.  The  following  set  of  conditions 
(sec  181  Theorem  1),  given  here  for  completeness,  characterizes  a suitable 
c vector. 


T 

c ••  r + M s,  (r,s)  > 0 

(2.1) 

MZi  = Z2  + vd^ 

(2.2) 

<M,(Y^-sd^)>  + (Y^-rd''^)  - 0 

(2.3) 

<r,Z^>  + <s,Z2>  - <v,(Y^-8d’^)>  - p^ 

(2.4) 

diag  p » diag  (Yj^+Y^)  > 0 

(2.5) 

Zj^,  Z2  G Z,  Yj^,  Y2,  d,  p ^ 0 

(2.6) 

where  r,  s,  d,  p are  all  in  r”  , and  Y2  are  all  in 

j^nxn  _ 2 ggj,  real  square  matrices  with  nonpositive  off- 

diagonal  elements. 

Because  of  the  presence  of  two  bilinear  conditions  (2.3)  and  (2.4), 
it  is  not  easy  in  general  to  determine  a c vector  for  an  arbitrary  M . 
however,  for  a number  of  special  cases  including  those  when  M is  a 
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Z-matrlx  • or  vrhea  M is  strictly  or  irreducibly  diagonally  dominant  [10] 
a suitable  c can  be  obtained  through  a series  of  intermediate  calculations 
and  the  linear  complementarity  problem  can  be  solved  as  an  ordinary  linear 
program. 

Unfortunately,  even  for  these  special  cases,  it  is  rarely  a straight- 
forward matter  of  identifying  the  matrices,  vectors,  and  side  conditions 
that  are  needed  to  calculate  a suitable  c vector.  When  the  dimensions 
of  the  problem  are  greater  than  three,  the  work  required  to  determine 
which  linear  program  to  solve  begins  to  rival  the  work  required  to  obtain 
a solution  to  LCP.  Those  cases  where  c can  be  easily  determined  are 
discussed  in  Section  5. 

4.  The  Relationship  Between  LP  and  MOGG 

In  addressing  LCP,  MOGG  sets  up  and  solves  a series  of  linear 
programs  that  closely  resemble  LP.  The  constraint  region  of  each  sub- 
problem is  identical  to  that  of  LP,  but  the  cost  coefficients  vary  from 
iteration  to  iteration.  Eventually,  MOGG  selects  a "correct"  set  of 
coefficients  and  produces  a solution.  The  coefficients  are  correct 
only  in  the  sense  that  the  supporting  hyperplane  (objective  function) 
at  the  solution  of  the  associated  linear  program  passes  through  the 
origin.  They  are  not  necessarily  equal  to  the  value  of  a c in  LP 
as  determined  by  conditions  (2.1)  - (2.6).  There  is  no  guarantee  that 
the  objective  function  in  LP  evaluated  at  the  solution  will  be  equal  to 
zero.  iG  sec  this,  let  us  Introduce  a set  of  auxiliary  variables  w^^ 

(1  * l,...,n)  for  the  purpose  of  transforming  (1)  into  a separable 
programming  problem;  that  is : 

n 

min  E { mln(0,w.)  + x.  } (3) 

xeS  i=l  ^ ^ 

weW 

subject  to 

w^  - M^x  i * l,...,n 
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where  W is  an  arbitrarily  large  hpyer rectangle  in  r"  . 

The  iterative  procedure  used  by  MOGG  to  solve  (3)  was  described 
in  Section  2.  The  equivalent  series  of  linear  programs  addressed  in 
this  procedure  can  be  given  in  terms  of  the  original  variables  and  a 
parameter  ct  in  k”  as  follows: 

n 

mL*  » 'I  { ^ (^*1) 

xcs  i»l 

wcW 


subject  to 


Wi  - M^x  i “ l,...,n  (4.2) 

where  assumes  one  of  the  following  three  values:  0,  1/2,  1, 

depending  upon  which  stage  the  algorithm  is  in.  At  the  first  stage, 

* 1/2  (1  = 1,  2,...,n)  ; this  represents  the  convex  underestimating 
problem.  Although  there  are  3*'  possible  combinations  of  the  a^'s, 
some  of  the  associated  linear  programs  turn  out  to  be  redundant  and  are 
not  addressed  by  MOGG.  It  is  possible  to  verify  through  enumeration  that 
2 - 1 is  the  maximum  number  of  subproblems  that  might  have  to  be 

solved. 


I.;ach  auxiliary  variable  w^^  in  problem  (4)  can  be  eliminated 
by  substituting  its  equivalent,  as  determined  from  (4.2),  into  (4.1), 
and  noting  that  W is  arbitrarily  large.  Lemma  2 in  [8]  assures  that 
the  solution  of  LCP  occurs  at  a vertex  of  S . The  resulting  problem  is 


n 

min  Z { X,  + a (M^x  - x.  + v.)  } 
xCS  i-1 


n 

<=>  min  Z { (1-a. )x.  + a.M.x  } , (5) 

xes  1-1 


which  has  the  same  constraint  region  as  LP;  hence,  any  solution  to  LP 
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will  be  boch  feasible  and  opclmal  to  (5).  This  leads  to  Che  following  lenuna 
which  characterizes  iounediate  solutions  to  LCP. 


LEMMA  1.  Let  the  linear  complementarity  problem  have  a solution, 
and  let  Che  objective  function  c of  the  associated  linear  program  satisfy 
conditions  (2.1)  - (2.6).  Now,  if,  for  some  y > 0 , 


=j  • ^ I "y)  • 


j - 1.  2,, 


(6) 


then  Falk's  algorithm  will  produce  a solution  to  either  problem  on  its 
first  iteration. 

This  can  be  seen  by  letting  » 1/2  (i  * l,...,n)  and  equating 
the  coat  coefficients  of  LP  and  (5).  The  applicability  of  this  result 
is  more  general  than  it  wcxild  first  appear  because  c will  usually  assume 
a range  of  values. 

In  fact,  (6)  is  only  a sufficient  condition  for  the  algorithm  to 

produce  a solution  on  its  first  iteration.  A necessary  and  sufficient 

condition  would  be  that  the  vector  y(1+  2 M ) ,i>=  l,2,...,n 

\ 

lie  in  Che  cone  formed  by  the  gradients  of  the  binding  constraints  of 
the  associated  linear  program.  This  condition,  of  course,  is  untestable 
in  chat  the  calculation  of  c offers  no  hint  as  to  which  constraints 
will  be  binding  at  Che  solution. 

5.  A Verifiable  Case 

In  general,  even  if  a suitable  c is  known,  the  only  way  to 
determine  if  MOGG  will  produce  a solution  to  LCP  on  its  first  iteration 
is  by  evaluating  (6).  In  this  section  we  examine  Che  special  case  where 
c assumes  a unit  structure  and  show  that  in  this  Instance  the  solution 
is  immediate.  A statement  of  this  result  is  contained  in  the  following 
theorem. 

THEOREM  1.  Let  x*  solve  LCP.  If  M is  such  that  c ■ Be 
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satisfies  conditions  (2.1)  - (2.6)  for  some  & > 0 and  e - (1,1,...,!) 
then  ^«x;G  will  produce  a solution  io  LCP  on  its  first  iteration. 

P;^OF;  Let  (x*,  u*,  u*)  in  R*'  x r”  x r”  solve  LP,  where  uj 
and  u*  are  the  Kuhn-Tucker  multipliers  associated  with  the  inequality 
constraints  Mx*  + v > 0 and  x*  > 0 , respectively.  It  will  be  shown 
that  there  exists  a corresponding  point  (x*,  u^^,  U2)  in  R*^  x r"  x r" 
that  satisfies  the  Kuhn-Tucker  conditions  for  (5)  with  = 1/2 

(i  * l,...,n)  and  is  thus  the  solution  to  the  first  subproblem  set  up  by 
MOGC. 


Letting  c = be  , the  first  order  necessary  conditions  for  LP 
that  require  that 


Multiplying  (8)  by  2b  and  rearranging  we  get 
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The  following  example  (81  illustrates  the  equivalence  stated  in 
Theorem  1 while  concurrently  demonstrating  the  impracticality  of  casting 
the  linear  complementarity  problem  as  a linear  prct;ram  when  c is  not 
explicitly  given.  The  example  is  based  on  the  following  theorem. 

THEORKM  2 (Mangasarlan  [81).  If  S i*  $ and  there  exist  r,s  in 
r",  in  r"’^"  such  that 

MZ^  “ ^2  ^ 

<r,Z^>  + <s,Z2>  > 0 


<r,(Z^+D)>  + <s,(Z2+D)>  > 0 , D - diag  d 

. 2,  la  Z i d,  r.  s > 0 | 

T { 

then  LCP  has  a solution  which  ran  be  obtained  by  solving  LP  with  c - r + M s . ji 

f 

EXAMPLE  1.  ! 


and  V 


This  example  satisfies  the  conditions  of  Theorem  2 with  d - s 


r - 0 , 


2 -1  -2\ 


and  Z. 


/ 


T T 

Now  c-r+Ms“0+Me*e;  hence,  by  Theorem  1 with  6 ■ 1 (or  Lemma  1 
with  Y ■ 1/2)  we  have  the  equivalence  of  (5)  and  LP.  As  expected,  the  first 
iteration  of  the  algorithm  produced  the  equilibrium  point  x*  - (2/5,  2/5,  1/5). 
it  is  interesting  to  note  that  this  problem  cannot  be  solved  by  either  Lemke's 
method  or  the  principal  pivoting  procedure  (4]. 

The  next  example  [8]  illustrates  the  case  where  a solution  to  the 
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linear  complementarity  problem  is  not  obtained  on  the  first  iteration 


of  MOtx;. 


EXAMPLE  2. 


(L!)  C) 


This  example  also  satisfies  the  conditions  of  Theorem  2 with 


r*’  - (0,1).  “ (1.0),  d"^'  = (0,2),  = 


1 0 


1 0 


-1  0 


and  c “ (-1,2)  . The  associated  linear  program  has  the  (unique)  solution 
» 1,  “ 0 which  expectedly  solves  the  linear  complementarity  problem. 

When  MOGG  was  used  to  solve  this  problem,  the  solution  was  found  after 
three  stages  of  branching  had  taken  place.  The  branch  and  bound  tree  is 
depicted  in  Figure  1,  and,  as  can  be  seen,  six  of  the  seven  potential 
subproblems  had  to  be  examined  before  convergence  could  be  established. 

(The  numbers  adjacent  to  the  nodes  represent  the  upper  and  lower  bounds 
fur  the  associated  subproblems.) 
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VHien  Letnke's  method  was  tried  on  this  problem,  an  unbounded 
(infeasible)  ray  was  generated  by  letting  , thus  precluding  a 

solution.  The  principal  pivoting  algorithm  also  ran  into  trouble  by 
cycling  rather  than  converging  to  solution. 

From  these  two  examples,  we  see  that  MOGG  offers  a clear  advan- 
tage in  solving  the  linear  complementarity  problem  over  the  principal 
alternatives.  Because  MOGG  does  not  insist  upon  a special  matrix 
structure,  it  will  solve  all  such  problems  without  first  having  to 
check  the  properties  of  M or  evaluate  an  often  unwieldy  set  of 
nonlinear  conditions. 

In  general,  the  branch  and  bound  approach  would  appear  to  offer 
the  dual  advantage  of  being  universally  applicable,  and  computationally 
superior.  This  results  directly  from  the  guaranteed  upper  bound,  and 
the  simple  three-segment  form  of  the  objective  function. 
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